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(54) DEVICE FOR CONFIRMATION OF REAR VIEW OF VEHICLE 



(57) A device mounted on a vehicle such as automo- 
biles for confirmation of the rear view of the vehicle. 
Mounted to a door end of the vehicle is a miniature CCD 
camera (2) which picks up and indicate an image of the 
rear view of the door on a monitor (4). A door opening 
detecting mechanism (1) is provided for detecting 
beforehand an opening movement of the door of the 
vehicle from an access of a hand to a door knob and door 
unlocking, and when an opening movement of the door 
is detected, the camera (2), a camera angle control 
mechanism (3) and the monitor (4) are turned ON to start 
imaging by the camera, control of a camera angle and 
indication on the monitor. The camera angle control 
mechanism (3) turns the camera in a reverse direction 
by an angle, through which the door is opened, and con- 
trols a direction of the camera (2) to keep it constant. 
Accordingly, it is possible to urge a crew's safety confir- 
mation at the time of getting-off through an indication rep- 
resentative of a rear view of the door and to have the 
crew visually identify information which are required for 
safety confirmation at the time of getting-off. 
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Description 

Technical Field 

The present invention relates to a rear safety check- 
ing apparatus for use with a vehicle such as a car. 

" Related Art 

In recent years, as video apparatuses, for example, 
imaging devices and displaying devices have been min- 
iaturized and improved, imaging devices have been used 
for safety checking apparatuses that improve the safety 
of the driving of vehicles. 

As a typical example of such safety checking appa- 
ratuses, a CCD camera is disposed at a rearmost portion 
of a vehicle. With the camera, a rear view image of the 
vehicle is picked up and the picked up image is displayed 
on a monitor disposed inside the vehicle. In this appara- 
tus, views just behind the vehicle, which cannot be 
obtained with a rear view mirror and door mirrors, can be 
securely obtained with a monitor. Thus, this apparatus is 
very effective when the driver suddenly drives the vehicle 
in rear direction. 

However, in this apparatus, since the pick-up-image 
range of the camera is limited to the behind of the rear- 
most portion of the vehicle. Thus, the camera cannot 
take images of other vehicles that are going to pass 
through the vehicle of the user. Consequently, an acci- 
dent may take place in such a way that an opened door 
contacts another vehicle or moving substance that fol- 
lows the vehicle of the user. 

Of course, such an accident can be prevented when 
the passengers carefully watch the rear through the rear 
view mirror and the door mirrors when they open the 
doors. However, since the passengers of the vehicle tend 
to disregard safety checks, such an accident often takes 
place. Particularly, in a vehicle with door mirrors, when 
doors are opened, since the view directions of the door 
mirrors largely deviate from the rear of the vehicle, the 
passengers cannot properly check the rear of the vehi- 
cle. 

In the conventional construction of this type, when 
the driver of the vehicle turns on the switch thereof or 
when the driver places the drive gear in the rear position, 
the system is turned on. Thus, such an apparatus is not 
suitable for urge the passengers who are getting off the 
vehicle to perform their safety check. 

As described above, in the conventional rear safety 
checking apparatus for use with a vehicle, since the view 
image behind the rearmost portion of the vehicle is 
picked up and displayed, the obtained information is 
improper for safety check for passengers who are getting 
off the v.eJjieJe. in addition, the apparatus is also improper 
for urging the passengers who are getting off the vehicle 
to perform the safety check. 

An object of the present invention is to solve such 
problems and to provide a rear safety checking appara- 
tus for use with a vehicle for deteeting'door'opeliing'oper- 



ation and for pickingjup images and displaying the rear 
views of theicte efiSisejasit QlallQwlt^ieTp^ssejgqers who 
are getting off the vehicle to properly perform safety 
check. 

5 

Disclosure of the Invention 

A vehicle rear safety checking apparatus of the 
present invention, comprising a pick-up-image means for 

10 picking up an image behind a vehicle, a displaying 
means for displaying the image picked up by the pick-up- 
image means, a detecting means for detecting an open- 
ing operation of a door disposed on the vehicle, and a 
controlling means for causing the displaying means to 

15 display the image picked up by the pick-up-image means 
when the opening operation.of the door is detected by 
the detectingcmeans. The pick-up-image means is dis- 
posed on a door end, preferably at a door end portion so 
as to pick up the image behind the door of the vehicle. 

20 In addition, a means for keeping the pick-up-image direc- 
tion of the pick-up-image means constant against the 
opening operation of the door is disposed. As an exam- 
ple of the detecting means, the lock releasing operation 
of the door and the approaching operation or the con 

25 tacting operation of a substance to the door knob inside 
the vehicle is detected as the door opening operation. 

According to the vehicle rear safety checking appa- 
ratus of the present invention, the detecting means 
detects the door opening operation. When the detecting 

30 means detects the door opening operation, the control- 
ling means causes the pick-up-image means to start 
picking up the rear image of the opened door and the 
displaying means to display the picked up image. Thus, 
according to the present invention, the apparatus can 

35 urge the passengers who are getting off the vehicle to 
perform safety check with the image of the rear of the 
opened door and provide the passengers who are get- 
ting off the vehicle with information necessary for the 
safety check. 

40 

Brief Description of Drawings 

Fig. 1 is a block diagram showing the overall con- 
struction of a vehicle rear safety checking apparatus 
45 according to an embodiment of the present inven- 
tion; 

Fig. 2 is a schematic diagram showing the construc- 
tion of a door open state detecting system; 
Fig. 3 is a schematic view showing a door knob hav- 
so ing an infrared ray sensor; 

Fig. 4 is a schematic diagram showing the construc- 
tion of a camera and a camera angle controlling sys- 
tem; 

Fig. 5 is a block diagram showing the construction 
55 of a controller of the camera angle controlling sys- 
tem; 

Fig. 6 is af low chart showing an operating procedure 
of a main CPU; 



2 



NSCXX10: <£P 070021 2A1_I_> 



3 



EP 0 700 212 A1 



4 



Fig. 7 is a flow chart showing an operating procedure 
of a controller; 

Fig. 8 is a perspective view showing a vehicle that 
is equipped with the vehicle rear safety checking 
apparatus according to the embodiment; 
Fig. 9 is a block diagram showing the overall con- 
struction of the vehicle rear safety checking appara- 
tus according to another embodiment of the present 
invention; 

Fig. 10 is a flow chart showing an operating proce- 
dure of the vehicle rear safety checking apparatus 
shown in Fig. 9; 

Fig. 1 1 is a block diagram showing the overall con- 
struction of a vehicle rear safety checking apparatus 
according to another embodiment of the present 
invention; 

Fig. 1 2 is a plan view showing a four-door type vehi- 
cle; 

Fig. 13 is a flow chart showing an operating proce- 
dure of the vehicle rear safety checking apparatus 
shown in Fig. 11; 

Fig. 1 4 is a perspective view showing another exam- 
ple of the vehicle that is equipped with the vehicle 
rear safety checking apparatus shown in Fig. 1 1 ; 
Fig. 15 is a block diagram showing a modification 
example of the construction of the vehicle rear 
checking apparatus shown in Fig. 1 1 ; 
Fig. 1 6 is a table showing the relation between door 
open/closed states and activated cameras of the 
vehicle rear safety checking apparatus shown in Fig. 
11; 

Fig. 1 7 is a flow chart showing an operating proce- 
dure of another embodiment of the present inven- 
tion; 

Fig. 1 8 is a table showing the relation between door 
open/closed states and activated cameras of the 
vehicle rear safety checking apparatus shown in Fig. 
17; 

Fig. 19 is a flow chart showing an operating proce- 
dure of another embodiment of the present inven- 
tion; 

Fig. 20 is a table showing the relation between door 
open/closed states and activated cameras of the 
vehicle rear safety checking apparatus shown in Fig. 
19; 

Fig. 21 is a flow chart showing an operating proce- 
dure of another embodiment of the present inven- 
tion; 

Fig. 22 is a table showing the relation between door 
open/closed states and activated cameras of the 
vehicle rear safety checking apparatus shown in Fig. 
21; 

Fig. 23 is a schematic diagram showing an example 
of a camera image priority displaying method; 
Fig. 24 is a schematic diagram showing another 
example of the camera image priority displaying 
method; 



Fig. 25 is a flow chart showing an operating proce- 
dure of another embodiment of the present inven- 
tion; 

Fig. 26 is a block diagram showing the overall con- 
s struction of a vehicl e rear safety checking apparatus 

according to another embodiment of the present 
invention; 

Fig. 27 is a perspective view showing the disposed 
position of a photo-coupler for detecting the expo- 
rt? sure of a CCD camera of the vehicle rear safety 
checking apparatus shown in Fig. 26; and 
Fig. 28 is a flow chart showing an operating proce- 
dure of another embodiment of the present inven- 
tion. 

75 

Best Modes for Carrying out the Invention 

Next, best modes for carrying out the present inven- 
tion will be described with reference to the accompany- 

20 ing drawings. 

Fig. 1 is a block diagram showing the overall con- 
struction of the vehicle rear safety checking apparatus 
according to an embodiment of the present invention. 
As shown in Fig. 1 . the vehicle rear safety checking 

25 apparatus comprises a door open state detecting system 
1. a CCD small camera 2. a camera angle controlling 
system 3. a monitor 4, and a main CPU 5. The door open 
state detecting system 1 detects the opening operation 
of a door of the vehicle. The CCD small camera 2 picks 

30 up the rear image of the door. The camera angle control- 
ling system 3 keeps the cfirection (pick-up-image direc- 
tion) of the camera 2 constant. The monitor 4 displays a 
door rear image picked up by the camera 2. The main 
CPU 5 totally controls each constructional portion of the 

35 apparatus. 

Fig. 2 is a schematic diagram showing an example 
of the construction of the door open state detecting sys- 
tem 1 . As shown in Fig. 2, the door open state detecting 
system 1 comprises a door lock release state detecting 

40 portion 6, an infrared ray sensor 7, and an -AND circuit 
8. The door lock release state detecting portion 6 detects 
the release state of the door lock. The infrared ray sensor 
7 is constructed of a photo-diode 7a and a photo-tran- 
sistor 7b and detects the touching operation of the door 

45 knob inside the vehicle. The AND circuit 8 ANDs a detec- 
tion signal S D received from the door lock release state 
detecting portion 6 and the inverted signal of a detection 
signal Sp received from the infrared ray sensor 7 and out- 
puts the resultant signal as a door open state detection 

so signal S1. The door open state detection signal S1 is 
supplied to the main CPU 5. 

As shown in Fig. 3. the photo-diode 7a and the 
photo-transistor 7b are disposed at positions so that 
when a passenger of the vehicle approaches his (her) 

55 hand to the door knob 10 in the vehicle, an infrared ray 
signal radiated by the photo-diode 7a is reflected by the 
hand of the passenger and then entered into the photo- 
transistor 7b. 
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Fig. 4 is a schematic diagram showing the construc- 
tion of the camera 2 and the camera angle controlling 
system 3. As shown in Fig. 4, the camera 2 is disposed 
at a door end portion so that it is exposed to the outside 

" when the door is open (see Fig. 8). The camera 2 is con- $ 
nected to a motor 13 through gears 12a and 12b. With 
the motor 13, the camera 2 can be rotated within prede- 

"* ter mined angles on a nearly horizontal plane against the 
road surface. 

In Fig. 4, reference numeral 14 is a door hinge. One 10 
end portion of the door hinge 14 is secured to the main 
body side of the vehicle. The other end portion of the 
door hinge 14 is movably inserted into the door 41. The 
other end portion of the door hinge 14 has a gear portion 
1 5. The gear portion 1 5 is connected to an angle detect- is 
ing volume controller 17 through a gear 16. In other 
words, as the door 41 is opened or closed, the door hinge 
1 4 is rotated about a fixed point on the vehicle main body 
side, the rotation of the door hinge 14 is transmitted to 
the angle detecting volume controller 17 through the so 
gear 1 6. The amount of the rotation of the door hinge 1 4 
is detected as a voltage V A . The voltage V A detected by 
the angle detecting volume controller 1 7 is supplied to 
the controller 18 at predetermined time intervals. 

As shown in Fig. 5, the controller 18 comprises an 25 
A/D converting portion 19. a ROM 20. a RAM 21, and a 
CPU 22. The A/D converting portion 1 9 converts an ana- 
log signal of the voltage V A received from the angle 
detecting volume 17 into a digital signal. The ROM 20 
that fixedly stores values of door open/close angles cor- 30 
responding to voltage values and so forth. The RAM 21 
stores the value of a door open/close angle sampled one 
cycle before. The CPU 22 executes an arithmetic oper- 
ation process for controlling the camera angle. 

Next, the operation of the vehicle rear safety check- 35 
ing apparatus according to the embodiment will be 
described. 

Fig. 6 is a flow chart showing the overall operation 
of the apparatus. First, the door open state detecting sys- 
tem 1 detects a door opening operation of a passenger 40 
of the vehicle as follows. As shown in Fig. 2, the door 
lock release state detecting portion 6 detects the release 
state of the door lock. Thereafter, the infrared ray sensor 
7 disposed at the door knob 10 shown in Fig. 3 detects 
the touching operation of the hand of the passenger to 45 
the door knob 10. 

In other words, the door lock release state detecting 
portion 6 sets the level of the detection signal S D to 
HIGH. When the detection signal S D becomes HIGH, the 
photo-diode 6a is turned on. When the passenger so 
approaches his hand to the door knob 10, the infrared 
ray signal of the photo-diode 6a is reflected by the hand 
and entered into the photo-transistor 6b. Thus, the photo- 
transistor 6b is turned on and a current flows therein. 
Consequently, the level of the collector voltage of the ss 
photo-transistor changes from HIGH to LOW. The result- 
ant collector voltage is supplied as a detection signal S F 
of the infrared ray sensor 6 to the AND circuit 8 through 
an inverter. Thus, a door open state detection signal S1 



that is the output signal of the AND circuit 8 becomes 
HIGH. 

When the main CPU 5 receives the door open state 
detection signal S1 (HIGH) and thereby knows that the 
door opening operation has been performed (at step 
601). it seg^tOdSN^tgnaLt athe-cam era 2, the camera 
angle controlling systenv3?^Sie5^Sor 4. Thus, the 
rear view irrage&ehindfoe doorj^ cam- 
era 2-and the camera angle is controlled (at step 602). 
In addition, the picked up image is displayed on the mon- 
itor 4 (at step 603). Thereafter, a-_ sound: atann^or urging 
the f pa^engers^whoarj_gettin^ perform 
their safety check (at step 604). This alarm is performed 
by a synthesized voice alarm message or a simple alarm 
sound. When the CPU 5 knows that the door has been 
closed (at step 605), it sends an OFF signal to the cam- 
era 2, the camera angle control system 3, and the motor 
4 and completes the operation (at steps 606 and 607). 

Next, the operation of the camera angle controlling 
system 3 will be described with reference to a flow chart 
of Fig. 7. 

When the CPU 22 of the controller 18 receives the 
ON signal from the main CPU 5 (at step 701), the CPU 
22 performs a start process for the camera angle con- 
trolling system 3 (at step 702). Thereafter, the CPU 22 
repeats the following process at predetermined time 
intervals. 

First, the CPU 22 receives the voltage V A corre- 
sponding to the amount of rotation of the door hinge 1 4 
from the angle detecting volume controller 1 7 through 
the A/D converting portion 17 (at step 703). Thereafter, 
the CPU 22 reads the value of the door open/close angle 
corresponding to the voltage value received from the 
ROM 20 (at step 704), subtracts the value of the door 
open/close angle one cycle before stored in the RAM 21 
from the read value of the door open/close angle (at step 

705) . The CPU 22 updates the content of the RAM 21 
with the value of the door open/close angle read from the 
ROM 20. In addition, the CPU 22 PWM-modulates the 
information of the obtained angular difference (at step 

706) and supplies the PWM modulation signal as a drive 
signal S A to the motor 13 through an amplifying circuit 
(not shown) (at step 707). Thereafter, the flow returns to 
step 703. At step 703, the CPU 22 reads the voltage V A 
from the angle detecting volume controller 1 7 and starts 
the process of the next cycle. Thus, the CPU 22 causes 
the camera 2 to rotate corresponding to the angle of the 
opened door in the reverse direction so as to keep the 
(pick-up-image) direction of the camera 2 constant. 
When the CPU 22 receives the OFF signal from the main 
CPU 5 (at step 708), the CPU 22 performs the reset proc- 
ess (at step 709) and completes the operation of the 
camera angle controlling system 3. 

Thus, according to the vehicle rear safety checking 
apparatus of the embodiment, when the door opening 
operation is detected, the rear view image of the vehicle 
is picked up by the camera 2 disposed at the door end. 
The picked up image is displayed on the monitor 4 along 
with the alarm sound so as to urge the passengers who 
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are getting off the vehicle to perform their safety check. 
In addition, the rear image of the vehicle, which is useful 
for the passengers who are getting off the vehicle to per- 
form their safety check, can be provided. 

Moreover, according to the vehicle rear safety 
checking apparatus of the embodiment, the pick-up- 
image direction of the camera 2 can be always kept con- 
stant regardless of the door open/close angle. 

Next, another embodiment of the present invention 
will be described. 

Fig. 9 is a block diagram showing the overall con- 
struction of a vehicle rear safety checking apparatus 
according to another embodiment of the present inven- 
tion. In Fig. 9, for simplicity, similar portions to those in 
Fig. 1 are denoted by similar reference numerals and 
their description is described. In Fig. 9, reference 
numeral 41 is a speed detecting circuit that detects the 
speed of the vehicle corresponding to the information 
received from a vehicle drive system. A speed signal S v 
is received from the speed detecting circuit 41. The 
speed signal S v is decoded by a decoder 42 and then 
sent to a speed indicator 43. Thus, the driver of the vehi- 
cle knows the speed of the vehicle with the speed indi- 
cator. The speed signal S v received from the speed 
detecting circuit 41 is also supplied to the main CPU 5. 
The main CPU 5 performs the following control corre- 
sponding to the speed signal S v 

Fig. 1 0 is a flow chart showing the control of the main 
CPU 5 corresponding to the speed signal S v . The main 
CPU 5 receives the speed signal S v from the speed 
detecting circuit 41 and determines whether or not the 
current speed of the vehicle accords with a predeter- 
mined value or less (at step 1001). In this case, the pre- 
determined value is almost zero. In other words, the 
predetermined value is a value equivalent to almost the 
stop state of the vehicle. More specifically, the predeter- 
mined value is a value equivalent to the state just before 
the vehicle is stopped. Thus, at step 1001, it is deter- 
mined whether or not the vehicle is in the state just before 
it is stopped (this state includes the stop state of the vehi- 
cle). When the speed accords with the predetermined 
value or less, the main CPU 5 sends the ON signal to 
the camera 2. the camera angle controlling system 3, 
and the monitor 4. Thus, the rear view image behind the 
door is picked up by the camera 2 and the camera angle 
is controlled (at step 1002). Consequently, the rear 
image behind the door is displayed on the monitor 4 (at 
step 1003). Thereafter, the main CPU 5 determines 
whether or not the door opening operation has been per- 
formed in a predetermined time period after the speed 
becomes the predetermined value or less (at steps 1004 
and 1005). When the door opening operation is per- 
formed, the rear image behind the door is continuously 
displayed. Even if the predetermined time period 
elapses, until the door is closed, the rear image behind 
door is continuously displayed. On the other hand, if the 
door opening operation is not performed in the predeter- 
mined time period, the main CPU 5 sends the OFF signal 
to the camera 2. the camera angle controlling system 3, 



and the monitor 4 so as to cause the monitor 4 to stop 
displaying the rear image behind the door (at step 1006). 

Thus, according to the embodiment (shown in Fig. 
9), since the rear image of the vehicle is displayed on the 
5 monitor just before the vehicle is stopped, the apparatus 
can urge the passengers who are getting off the vehicle 
to perform their safety check at more proper timings. In 
addition, if the door opening operation is not performed 
in the predetermined time period after the speed 
10 decreases to the predetermined value or less, the dis- 
play of the rear image is stopped, thereby suppressing 
the power consumption of the apparatus. 

Next, another embodiment of the present invention 
will be described. 
is Fig. 1 1 is a block diagram showing the overall con- 
struction of a vehicle rear safety checking apparatus 
according to another embodiment of the present inven- 
tion. In Fig. 1 1 . for simplicity, similar portions as those 
shown in Fig. 1 are denoted by similar reference numer- 
ic als and their description is omitted. In Fig. 11, CMR1, 
CMR2, CM LI , and CML2 are cameras. As shown in Fig. 
12, these cameras -CMB1~CMB2; ; CMLI ; and CML2 are 
disposed at doors DRR1 , DRR2, DRL1 , and DRL2; of a 
four-door type vehicle, respectively The camera CMR1 
25 is disposed at the front right side door DRR1 of the vehi- 
cle. The camera CMR2 is disposed at the rear right side 
door DRR2 of the vehicle. The camera CML1 is disposed 
at the front left side doorDRLI of the vehicle. The camera 
CML2 is disposed at the rear left side door DRL2 of the 
30 vehicle. In Fig. 11, reference;numeral:51~js:a_door open 
state detecting system that detects opening operations 
(or their pre-operations) of the doors of the vehicle. The 
door open state detecting system 51 has four switches 
SW1, SW2, SW3, and SW4. The switches SW1, SW2, 
35 SW3, and SW4 become open and closed states when 
the doors DRR1, DRR2. DRL1, and DRL2 are closed 
and opened, respectively Reference numeral 52 is a 
door flag generating circuit that identifies the 
open/closed states of the switches SW1 to SW4, logi- 
40 cally generates "H" level flag information when one of the 
switches becomes the off state, adds off-state switch ID 
information to the flag information, and sends the result- 
ant informations the main CPU 5. The main CPU 5 exe- 
cutes the following control corresponding to the flag 
45 information and so forth received from a door flag gen- 
erating circuit 52. 

Fig. 1 3 is a flow chart showing the control of the main 
CPU 5 corresponding to the flag information. When the 
flag information is supplied to the main CPU 5, it checks 
so the switch ID information included in the flag information 
so as to determine which door has been opened (at steps 
1301 and 1302). Thus, if the right side door DRR1 or 
DRR2 has been opened, the main CPU 5 causes the 
image picked up by the camera CMR1 or CMR2 dis- 
ss posed at the right side door DRR1 or DRR2 to:be^disr 
play9d on the-monitpr 4 (at step 1303). On the other 
hand, when the left side door QRL1 or DRL2 has been 
opened, the main CPU 5 causes the image picked up by 
the camera CML1 or CML2 disposed at the left side door 
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DRL1 or~DRL2 to be displayed orvthe monitor 4 (at step 
1304). 

In other words, according to the embodiment (shown 
in Fig. 1 1). a camera image on the side of which a door 
" is opened first is displayed with priority. Thus, a camera 5 
image on the side of which a door is opened secondly is 
j not displayed. 

When the main CPU 5 knows that the door that has 
been opened is closed corresponding to the reset state 
of the flag information (at step 1305), the main CPU 5 io 
causes the camera image on the opened door side to be 
stopped (at step 1306). 

As shown in Fig. 14, the camera image selecting 
control is applicable to the construction of which cameras 
CMR and CML are disposed on the left and right of a is 
rear bumper of the vehicle. Fig. 15 is a block diagram 
showing the overall construction of a vehicle rear side 
checking apparatus according to this embodiment In the 
embodiment (shown in Fig. 1 5), a door open state detect- 
ing system 62 has two switches SW1 and SW2 corre- 20 
spending to cameras CMR and CML When the 
front/rear right side door of the vehicle is opened, the 
camera CMR is turned on until the door is closed. On the 
other hand, when the front/rear left side door of the vehi- 
cle is opened, the camera CML is turned on until the door 25 
is opened. Reference numeral 63 is a door flag generat- 
ing circuit that determines the open/closed states of the 
switches SW1 and SW2, generates logical "H" level flag 
information when one of the switches is closed, adds 
close-state switch ID information to the flag information, 30 
and outputs the resultant information to the main CPU 5. 
Since the operation of the vehicle rear safety checking 
apparatus of this embodiment is the same as that of the 
above-described embodiments, the description thereof 
is omitted. 35 

Fig. 16 is a table showing the relation between the 
open/closed states of the doors and the activated cam- 
eras. In the table, circles "O" represent that either the 
open state or closed state is possible. 

Next, another embodiment of the present invention 40 
will be described. 

In this embodiment, the overall construction is the 
same as that shown in Fig. 1 1 . However, in this embod- 
iment, the main CPU 5 performs a camera image select- 
ing control corresponding to opening operations of the 45 
doors of the vehicle. In other word, in the embodiment, 
the priority orders are designated to the front seats and 
the rear seats. When a rear seat side door is opened, an 
image of the cameraof the doorJs displayed with priority. 
Next, the detail control flow will be described with refer- so 
ence to a flow chart of Fig. 1 7. 

In Fig. 17. F represents flag information correspond- 
ing to the front seat side doors and R represents flag 
information corresponding to the rear seat side doors. 
The door flag generating circuit 52 initializes the flag 55 
information F and R (namely, clears them to zero) (at step 
1701). Thereafter, the door flag generating circuit 52 
determines the open/closed states of the four switches 
SWT, SW2. SW3. and SW4 of the door open state 



detecting system 51 and checks the door opening oper- 
ations of the doors (at step 1 702). When at least one of 
the switches SW1 and SW3 is in the closed state (at step 
1703). the door flag generating circuit 52 sets the flag 
information F corresponding to the front seat side doors, 
adds open-door ID information to the flag information, 
and outputs the resultant information to the main CPU 5 
(at step 1704). Likewise, when at least one of the 
switches SW2 and SW4 is in the closed state (at step 
1705), the door flag generating circuit 52 sets the flag 
information R corresponding to the rear seat side doors, 
adds the open-door ID information to the flag informa- 
tion, and sends the resultant information to the main CPU 
5 (at step 1706). 

The main CPU 5 successively reads the flag infor- 
mation F and R corresponding to the front seat side 
doors and the rear seat side doors. When the set state 
flag information that has been read first represents the 
front seat side doors, the corresponding camera is iden- 
tified corresponding to the door ID information added to 
the flag information F and the camera image is displayed 
on the monitor 4 (at steps 1 707 and 1 708). When the flag 
information corresponding to the rear seat side doors is 
received, a camera image on the front seat side door is 
switched to a camera image on the rear seat side door 
as a priority image (at steps 1709 and 1710). 

When the set state flag information that has been 
read first represents the rear seat side doors, a camera 
image on a rear seat side door is displayed. 

Thus, according to the embodiment (shown in Fig. 
17), when a front side door and a rear side door are 
opened even if the rear side door disturbs the pick-up- 
image operation of the camera of the front side door, 
since the image of the camera at the rear seat side door 
has priority over the image of the camera at the front seat 
side door, the rear image can be securely picked up and 
displayed on the monitor. 

Fig. 18 is a table showing the relation between the 
open/closed states of the doors and the activated cam- 
eras. 

Next, another embodiment of the present invention 
will be described. 

In this embodiment, the overall construction of the 
apparatus is the same as that shown in Fig. 1 1 . However, 
in this embodiment, the main CPU 5 performs the follow- 
ing camera image selecting control corresponding to the 
opening operations of the doors of the vehicle. In other 
words, priority orders are designated to the driver's seat 
and passenger seats. When a door of other than the 
driver's seat is opened, an image of a camera at the door 
is displayed with priority. Next, the detailed control flow 
will be described with reference to a flow chart of Fig. 1 9. 

In Fig. 19. D represents flag information correspond- 
ing to the driver's seat side door. MD represents flag infor- 
mation corresponding to the other seat side doors. The 
doorf lag generating circuit 52 initializes the flag informa- 
tion D and ND (namely, clears them to zero) (at step 
1901), determines the open/closed states of the 
switches SW1, SW2. SW3, and SW4 of the door open 
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; state detecting system 51 , and checks the opening oper- 
ations of the doors of the vehicle (at step 1902). When 
the switch SW1 is in the closed state (at step 1903). the 
door flag generating circuit 52 sets the flag information 
D corresponding to the driver's seat side door, adds the 5 
ID information of the driver's seat side door to the flag 
information, and outputs the resultant information to the 
main CPU 5 (at step 1904). Likewise, when at least one 
of the switches SW2 to SW4 is in the closed state (at 
step 1905), the door flag generating circuit 52 sets the 
flag information ND corresponding to doors other than 
the driver's seat side door, adds the ID information of the 
opened door to the flag information, and outputs the 
resultant information to the main CPU 5 (at step 1 906). 

The main CPU 5 successively reads the flag infor- 
mation D and ND. When the set state flag information 
that has been read first is information corresponding to 
the driver's seat side door, a camera image on the 
driver's seat side door is displayed on the monitor 4 (at 
steps 1 907 and 1 908). Thereafter, when the set statef lag 
information that has been read first is information corre- 
sponding to other than the driver's seat, a camera image 
on the driver's seat side door is switched to a camera 
image on other than the driver's seat side door as a pri- 
ority image (at steps 1909 and 1910). 

When the set state flag information that has been 
read first is information corresponding to other than the 
driver's seat, a camera image on other than the driver's 
seat side door is displayed. 

Fig. 20 is a table showing the relation between the 
open/closed states of the doors of the vehicle and the 
activated cameras. 

Thus, according to the embodiment (shown in Fig. 
19), the driver can totally check the rear views behind 
opened doors at the driver's seat so as to perform safety 
check for passengers who are getting off the vehicle. 

Next another embodiment of the present invention 
will be described. 

In this embodiment, the overall construction of the 
apparatus is the same as that shown in Fig. 1 1 . However, 
in this embodiment, the main CPU 5 performs the follow- 
ing camera image selecting control corresponding to the 
opening operations of the doors of the vehicle. In other 
words, in this embodiment, priority orders are designated 
to all passenger seats. When a passenger seat side door 
with higher priority is opened, a camera image thereof is 
displayed with higher priority than camera images of pas- 
senger seats with lower priority. Next, the detailed control 
flow of this embodiment will be described with reference 
to a flow chart of Fig. 21 . 

In this case, the priority orders can be freely desig- 
nated to the passenger seats. However, in this embodi- 
ment, the least priority order is designated to the driver's 
seat. Higher priority orders are designated to passenger 
seats that are farther from the driver's seat. As a specific 
example of the priority designation, priority orders are 
designated in the order of DRR1 -> DRL1 -> DRR2 -> 
DRL2 as shown in Fig. 12. In Fig. 21, D represents flag 
information correspondng to the door DRR1 of the 



driver's seat. ND1 represents flag information corre- 
sponding to the door of the passenger seat DRL1 . ND2 
is flag information corresponding to the door of the pas- 
senger seat DRR2. ND3 is flag information correspond- 
ing to the door of the passenger seat DRL2. 

First, thedoorf lag generating circuit 52 initializes the 
flag information D and ND1 to ND3 (namely, clears them 
to zero) (at step 2101), determines the open/closed 
states of the four switches SW1, SW2, SW3. and SW4 
of the door open state detecting system 51 , and checks 
the opening operations of the doors (at step 2 1 02). When 
the switch SWi is in the closed state (at step 2103), the 
door flag generating circuit 52 sets the flag information 
D corresponding to the door DRR1 of the driver's seat, 
adds the door ID information of the driver's seat to the 
flag information, and outputs the resultant information to 
the main CPU 5 (at step 2104). Likewise, when one of 
the switches SW2 to SW4 is in the closed state (at steps 

2105, 2107, and 2109), the door flag generating circuit 
52 sets the flag information ND1 ( ND2, and ND3 corre- 
sponding to the doors DRL1. DRR2, and DRL2 other 
than the door of the driver's seat, adds the ID information 
of the opened door to the flag information, and outputs 
the resultant information to the main CPU 5 (at steps 

2106, 2108. and 21 10). 

The main CPU 5 successively reads the flag infor- 
mation D and ND1 to ND3 and causes a camera image 
on a passenger seat side door corresponding to the flag 
information that has been received first to be displayed 
on the monitor 4. When the main CPU 5 receives the 
next flag information, if the priority order of the door cor- 
responding to the flag information is higher than that of 
the camera image that is being displayed, the main CPU 
5 switches the current camera image into a camera 
image on the door corresponding to the flag information 
that has been newly received as a priority camera image. 
Thereafter, likewise, the CPU 5 causes a camera image 
with higher priority to be displayed corresponding to the 
priority order of the current camera image and corre- 
sponding to the flag information that has been newly 
received. This process is performed at steps 2111 to 
2118 shown in Fig. 21. 

Thereafter, when all the doors are closed, the door 
flag generating circuit 52 determines that all switches 
SW1 to SW4 are in the closed state (at step 2119) and 
resets all the flag information (at step 2120). Thus, the 
main CPU 5 causes the displaying of the camera image 
to be stopped (at step 2121). 

Fig. 22 is a table showing the relation between the 
open/closed states of the doors of the vehicle and the 
activated cameras. 

Thus, according to the embodiment (shown in Fig. 
21). since camera images on the rear passenger seat 
side doors that are most difficult to watch from the driver's 
seat are displayed with higher priority, the vehicle rear 
monitoring function of the apparatus can be more effec- 
tively used so as to improve the safety. 
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Since the vehicle rear safety checking apparatus 
according to the present invention may be modified in 
various manners, examples thereof will be descrfced. 

In the construction of which other media information 
such as television images is displayed on the monitor 4, 
when the main CPU 5 sends the ON signal to the monitor 
„ 4, the current image on the monitor 4 is forcedly switched 
to a camera image. 

In the case of a slide door type vehicle, the camera 
angle controlling system 3 can be omitted. 

The monitor screen can be divided into left and right 
portions. In other words, when left and right side doors 
are opened at the same time, images picked up by cam- 
eras disposed at these doors are displayed on the mon- 
itor at the same time. 

The door open state detecting system 1 may be con- 
structed so that when the door lock is released or a sub- 
stance approaches or contacts the door knob, the door 
open state detecting system 1 supplies a door open state 
detection signal S1 to the main CPU 5. 

In addition, unlike with the above-described embod- 
iments of which the current image is switched to a cam- 
era image with higher priority, other methods are 
available. 

For example, as shown in Fig. 23, a monitor screen 
is divided in such a manner that camera images with 
higher priority orders are displayed in larger divided por- 
tions. 

Alternatively, as shown in Fig. 24. camera images 
with higher priority orders are successively overlaid on 
those with lower priority orders. 

As a camera image displaying means, a camera 
image may be projected on the windshield of the vehicle. 

In the above-described embodiments, the door 
opening operation is determined by detecting a pre-oper- 
ation performed before the door is opened. However, the 
door opening operation can be determined by monitoring 
the rotating state of the door. 

For example, the voltage V A supplied from the vol- 
ume controller 1 7 shown in Fig. 4 is monitored. Thereaf- 
ter, assuming that a time point of which the value of the 
voltage V A varies is the start point of the opening oper- 
ation of the door, a signal that represents the opening 
operation of the door is supplied to the main CPU 5, 
Thus, the CPU 5 causes the image picked up by the CCD 
camera 2 to be displayed on the monitor 4. 

In the above-described embodiments, when the 
main CPU 5 detects the door opening operation, the 
main CPU 5 causes the image picked up by the CCD 
camera 2 to be displayed on the monitor 4. However, the 
image displayed on the monitor 4 is not limited to the 
image picked up when the door opening operation is 
detected. In other words, at least as long as the door is 
in the open state, the image picked up by the CCD cam- 
era 2 is continuously displayed. 

In addition, as shown in Fig. 8. when the CCD cam- 
era 2 is disposed at the door end portion, a predeter- 
mined time period is required after the door opening 
operation is detected until a valid image for the rear 



check is obtained. This is because when the door open- 
ing operation is started, the CCD camera 2 has not been 
completely exposed to the outside as shown in Fig. 8. 
Just after the door opening operation is started, a 

5 valid image useful for performing rear check is not dis- 
played. To solve this program, the apparatus as shown 
in Fig. 1 is controlled in the following manner. 

Fig. 25 is a flow chart showing the control procedure. 
At step 251 , the main CPU 5 knows that the door is in 

10 the open state corresponding to the door open state 
detection signal S1 received from the door open state 
detecting system 1 . When the door is open, the flow 
advances to step 252 (in the Y direction of the flow chart) . 
At step 252. the main CPU 5 counts a predetermined 

75 time period. When the predetermined time period 
elapses, the flow advances to step 253. At step 253. an 
image is displayed. 

The predetermined time period is preferably a time 
period after the door is opened until the CCD camera 2 

20 is fully exposed to the outside as shown in Fig. 8. Alter- 
natively, considering an allowance, the image may be 
displayed just before the CCD camera 2 is fully exposed 
to the outside. The predetermined time period can be 
experimentally obtained. Just before the CCD camera 2 

25 is fully exposed or when the door opening operation is 
detected, if the CCD camera 2 starts picking up an 
image, the image can be prevented from getting disor- 
dered. 

When the image is displayed at step 253. the flow 

30 advances to step 254. At step 254. it is determined 
whether or not the door is in the closed state. Unless the 
door is in the closed state, the flow enters a loop between 
steps 253 and 254. Thus, the image is continuously dis- 
played at step 253. When the door is closed, the flow 

35 advances to step 255. At step 255, it is determined 
whether or not a predetermined time period elapsed after 
the door was closed. The displaying of the image is 
securely stopped at step 255 along with step 256. The 
predetermined time period at step 255 may be for exam- 

40 pie zero. 

As described above, according to the embodiment 
(shown in Fig. 25), an invalid image that is not useful for 
a rear check can be prevented from being displayed just 
after the door opening operation is started. 

45 Another embodiment that can solve the above- 
described program will be described. 

Fig. 26 is a block diagram showing the construction 
of this embodiment In this embodiment, a detecting 
means for detecting whether or not the CCD camera 2 

so is exposed to the outside is added to the construction of 
the embodiment shown in Fig. 1 . Since the other portions 
of the embodiment shown in Fig. 26 are the same as 
those shown in Fig. 1 , their description is omitted. 

In Fig. 26. PC is a photo-coupler that constructs a 

55 part of the detecting means. The photo-coupler PC is 
constructed of a light emitting diode Pd (that is a known 
light emitting device) and a photo-transistor Pt (that is a 
light receiving device). As shown in Fig. 27, the photo- 
coupler PC is disposed at the door end portion of the 



8 



<EP 070021 2A1 J _> 



15 



EP 0 700 212 A1 



16 



door DM along with the CCD camera 2. The photo-cou- 
pler PC is disposed in such a manner that light emitted 
from the light emitting diode Pd is reflected and entered 
into the photo-transistor Pt when the door Dr1 is closed 
(namely, when the CCD camera 2 is not exposed to the 
outside). SW is a switch that turns on/off the function of 
the photo-coupler PC. The cathode of the photo-coupler 
PC is connected to a voltage source V cc through a 
switch SW. The cathode voltage is applied correspond- 
ing to a control signal received from the main CPU 5. The 
collector of the photo-transistor Pt is connected to the 
main CPU 5 through a resistor R. 

Next, the operation of the embodiment (shown in 
Fig. 26) will be described with reference to a flow chart 
shown in Fig. 28. First at step 281 , the door open/closed 
state is detected. At this point, the open/closed state of 
the door Dr1 at which the CCD camera 2 is disposed is 
detected. When the open state of the door Drl is 
detected, the flow advances to step 282. At step 282, the 
switch SW is turned on so that the limit emitting diode 
Pd emits light. Thus, before the door Dr1 is opened, the 
light emitting diode Pd does not emit light, thereby reduc- 
ing the power consumption of the apparatus. 

At step 283, it is determined whether or not the 
photo-coupler PC is in the ON state. When the photo- 
coupler PC is in the ON state, since the photo-transistor 
Pt receives light emitted from the light emitting diode Pd, 
the CCD camera 2 is not exposed to the outside. When 
the photo-coupler PC is not in the ON state, it is deter- 
mined that the CCD camera 2 is exposed to the outside. 
Thus, the flow advances to step 284. At step 284, an 
image (picked up by the CCD camera 2) is displayed. 

Step 284 forms a loop along with step 285. In this 
loop, until the door is closed, the image is continuously 
displayed. When it is determined that the door Dr1 is in 
the closed state at step 285, the flow advances to step 
286. After a predetermined time period elapses, the flow 
advances to step 287. At step 287, the displaying of the 
image is stopped. At step 286, the displaying of the 
image is securely stopped after the door Drl is closed 
along with step 287. The predetermined time period may 
be zero. After the displaying of the image is stopped, the 
switch SW is turned off at step 288 and thereby the emit- 
ting of light of the light emitting diode Pd is stopped. 

In the embodiment (shown in Fig. 26), as the means 
for detecting the exposure of the CCD camera 2, the 
photo-coupler PC is disposed at the door end portion. 
However, the detecting means is not limited to such a 
construction. For example, the rotating state of the door 
can be monitored. When the door is rotated for a prede- 
termined angle or more, it is determined that the CCD 
camera 2 is exposed to the outside. It is not necessary 
to fully expose the CCD camera 2 to the outside as long 
as the CCD camera 2 can pick up a rear image of the 
vehicle. 

The monitor 4 can be disposed at a position of which 
the driver and another passenger on the front seat side 
can watch an image of the rear of the vehicle. Alterna- 
tively, the monitor 4 can be disposed at a position of 



which passengers on the rear seats can watch the 
image. As another alternative way. the same monitors 
may be disposed as dedicated monitors for passenger 
seats. 

5 

Industrial Utilization 

As described above, the vehicle rear safety checking 
apparatus according to the present invention can be 
io used for every vehicle as an apparatus for performing a 
safety check for passengers who are getting off the vehi- 
cle. 

Claims 

75 

1. A vehicle rear safety checking apparatus, compris- 
ing: 

pick-up-image means for picking up an image 
behind a vehicle; 
20 displaying means for displaying the image 

picked up by said pick-up-image means; 

detecting means for detecting an opening 
operation of a door disposed on the vehicle; and 

controlling means for causing said displaying 
25 means to display the image picked up by said pick- 
up-image means when the opening operation of the 
door is detected by said detecting means. 

2. The vehicle rear safety checking apparatus as set 
30 forth in claim 1 , 

wherein said pick-up-image means is 
adapted for picking up an image behind the door. 

3. The vehicle rear safety checking apparatus as set 
35 forth in claim 1 , 

wherein said pick-up-image means is dis- 
posed at the door. 

4. The vehicle rear safety checking apparatus as set 
40 forth in claim 3. further comprising: 

means for keeping the pick-up-image direc- 
tion of said pick-up-image means almost constant 
against an open/close operation of the door. 

45 5. The vehicle rear safety checking apparatus as set 
forth in claim 1 , 

wherein said detecting means is adapted for 
detecting a lock releasing operation of the door as 
the opening operation of the door. 

so 

6. The vehicle rear safety checking apparatus as set 
forth in claim 1 , 

wherein said detecting means is adapted for 
detecting the approaching or contacting of another 
55 substance to a door knob inside the vehicle as the 
door opening operation. 

7. A vehicle rear safety checking apparatus, compris- 
ing: 
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pick-up-image means for picking up an image 
behind a vehicle; 

displaying means for displaying the image 
picked up by said pick-up-image means; 

speed detecting means for detecting the s 
speed of the vehicle; and 

controlling means for causing said displaying 
means to display the image picked up by said pick- 
up-image means when the speed detected by said 
speed detecting means drops to a predetermined w 
value or less. 

8. The vehicle rear safety checking apparatus as set 
forth in claim 7, further comprising: 

door open/close detecting means for detect- i$ 
ing an opening operation of a door disposed on the 
vehicle, 

wherein an image displayed by said dsplay- 
ing means is stopped when a predetermined time 
period elapses after the speed detected by said so 
speed detecting means drops to the predetermined 
value or less. 

9. The vehicle rear safety checking apparatus as set 
forth in claim 7, 25 

wherein the predetermined value of the vehi- 
cle is a value equivalent to an almost stop state of 
the vehicle. 

10. The vehicle rear safety checking apparatus as set 30 
forth in claim 8. 

wherein the predetermined value of the vehi- 
cle is a value equivalent to an almost stop state of 
the vehicle. 

35 

1 1 . A vehicle rear safety checking apparatus for use with 
a vehicle having a left-side door and a right-side 
door, comprising: 

two or more pick-up-image means for moni- 
toring a rear left side image and a rear right side 40 
image behind the vehicle; 

displaying means for displaying the images 
picked up by said two or more pick-up-image means; 

detecting means for detecting the opening of 
each of the doors disposed on the vehicle; and 45 

controlling means for causing said displaying 
means to display an image behind a door that is 
opened as a priority image over images behind the 
other doors when the opening of the door is detected 
by said detecting means. so 

1 2. A vehicle rear safety checking apparatus for use with 
a vehicle having front seat side doors and rear seat 
side doors, comprising: 

a plurality of pick-up-image means disposed ss 
at the doors or portions that are rotated along with 
the doors and adapted for picking up images behind 
the vehicle; 

displaying means for displaying the images 



picked up by said plurality of pick-up-image means; 

detecting means for detecting the opening of 
each of the doors disposed on the vehicle; and 

controlling means for causing said displaying 
means to display an image picked up by said pick- 
up-image means disposed at one of the rear seat 
side doors or a portion rotated along with the door 
as a priority image over images picked up by the 
other pick-up-image means when the opening of the 
door is detected by said detecting means. 

13. A vehicle rear safety checking apparatus for use with 
a vehicle having left side doors and right side doors, 
comprising: 

two or more pick-up-image means for moni- 
toring a rear left image and a rear right image behind 
the vehicle; 

displaying means for displaying the images 
picked up by said pick-up-image means; 

detecting means for detecting the opening of 
each of the doors disposed on the vehicle; and 

controlling means for causing said displaying 
means to display an image behind a door of other 
than a driver's seat as a priority image over images 
behind the other doors when the opening of the door 
is detected by said detecting means. 

14. A vehicle rear safety checking apparatus, compris- 
ing: 

a plurality of pick-up-image means disposed 
at doors of a vehicle or portions rotated along with 
the doors and adapted for picking up images behind 
the vehicle; 

displaying means for displaying the images 
picked up by said plurality of pick-up-image means; 

detecting means for detecting the opening of 
each of the doors disposed on said vehicle; and 

controlling means for causing said displaying 
means to display an image behind a door that is 
opened and that is the farthest from a driver's seat 
as a priority image over images behind the other 
doors when the opening of the door is detected by 
said detecting means. 

15. A vehicle rear safety checking apparatus, compris- 
ing: 

pick-up-image means for picking up an image 
behind a vehicle; 

displaying means for displaying the image 
picked up by said pick-up-image means; 

detecting means for detecting an opening 
state of a door disposed on the vehicle; and 

controlling means for causing said displaying 
means to display the image picked up by said pick- 
up-image means when the opening state of the door 
is detected by said detecting means. 

16. The vehicle rear safety checking apparatus as set 
forth in claim 15, 
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wherein said detecting means is adapted for 
monitoring a rotating state of the door so as to detect 
the opening state of the door. 

17. The vehicle rear safety checking apparatus as set s 
forth in claim 1 , 

wherein said pick-up-image means is dis- 
posed at a rear end portion of the door and exposed 
for taking the image behind the vehicle when the 
door is open. io 

18. The vehicle rear safety checking apparatus as set 
forth in claim 15. 

wherein said pick-up-image means is dis- 
posed at a rear end portion of the door and exposed 15 
for taking the image behind the vehicle when the 
door is open. 

19. The vehicle rear safety checking apparatus as set 
forth in claim 17. further comprising: 

controlling means for causing said displaying 
means to display the image picked up by said pick- 
up-image means when a predetermined time period 
elapses after the opening of the door is detected by 
said detecting means 

20. The vehicle rear safety checking apparatus as set 
forth in claim 18. further comprising: 

controlling means for causing said displaying 
means to display the image picked up by said pick- 30 
up-image means when a predetermined time period 
elapses after the opening of the door is detected by 
said detecting means. 

21. The vehicle rear safety checking apparatus as set 35 
forth in claim 17, further comprising: 

exposing state detecting means for detecting 
an exposing state of said pick-up-image means; and 

controlling means for causing said displaying 
means to display the image picked up by said pick- 40 
up-image means when the exposing state of said 
pick-up-image means is detected by said exposing 
state detecting means. 

22. The vehicle rear safety checking apparatus as set 
forth in daim 18. further comprising: 

exposing state detecting means for detecting 
an exposing state of said pick-up-image means; and 

controlling means for causing said displaying 
means to display the image picked up by said pick- 
up-image means when the exposing state of said 
pick-up-image means is detected by said exposing 
state detecting means. 
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